United States Patent [19] 

Smailagic et al. 



[54] PORTABLE COMPUTER SYSTEM WITH 
ERGONOMIC INPUT DEVICE 

[75] Inventors: Asim SmaUagic; John Michael 

Stivoric; Daniel Paul Siewiorek; Drew 
Anderson, all of Pittsburgh, Pa. 

[73] Assignee: Carnegie Mellon University, 
Pittsburgh, Pa. 

[21] Appl. No.: 08/960,541 
[22] Filed: Oct. 31, 1997 

Related U.S. Application Data 

[63] Continuation of application No. 08/399,203, Mar. 6, 1995, 
abandoned. 

[51] Int. CI. 6 G09G 5/00 

[52] U.S. CI 345/156; 345/157; 345/167; 

341/22; 364/708.1 

[58] Field of Search 345/156, 157, 

345/163, 166, 167, 169, 184, 905; 364/708.1, 
709.11; 248/917; D14/106, 114; 341/20-22; 

340/825.19 

[56] References Cited 

U.S. PATENT DOCUMENTS 



4,561,049 12/1985 Deleganes et al 345/184 

5,095,303 3/1992 Clark el al 345/164 

5,105,338 4/1992 Held D14/106 

5,305,244 4/1994 Newman et al 364/708.1 

5,305,449 4/1994 Ulenas 345/163 

5,438,530 8/1995 Bettini 364/708.1 



!llllllli!llll|l|llllllllllllll'lllllllllllllllll 

US005959611A 
[ii] Patent Number: 5,959,611 
[45] Date of Patent: Sep. 28, 1999 



5,459,462 10/1995 Venkidu et al 341/22 

5,477,508 12/1995 Will 368/189 

5,521,617 5/1996 Imai et al 345/167 

5,589,893 12/1996 Gaughan et al 345/167 

5,627,531 5/1997 Posso et al 341/22 

OTHER PUBLICATIONS 

"Rotating Icon Selector" IBM Technical Disclousure vol. 
37, No. 07, Jul. 1994, p. 59. 

Anthony Ralston "Encyclopedia of Computer Science" 
1995 pp. 182. 

Primary Examiner— Amare Mengistu 

Attorney, Agent, or Firm — Kirkpatrick & Lockhart LLP 

[57] ABSTRACT 

A portable computer system with an ergonomic input device 
is comprised of a housing having a top surface. A central 
processing unit is carried in the housing. A heads-up display 
is provided for displaying information to a user, with certain 
of the information being selectable by the user. The display 
is under the control of the central processing unit. A first 
rotary switch produces a first input signal for identifying the 
information to be selected. A second input switch produces 
a second input signal for selecting the identified information. 
Both the first and second input switches are carried on the 
top surface of the housing. An input interface receives the 
first and second input signals and encodes the information 
therein into an eight bit byte for input to the central pro- 
cessing unit. In one embodiment, the housing may be carried 
in a case which is worn by the user while the heads-up 
display is positioned proximate to the user's eye by a 
headband. 

24 Claims, 6 Drawing Sheets 
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PORTABLE COMPUTER SYSTEM WITH positioned proximate to the user's eye by a headband. The 

ERGONOMIC INPUT DEVICE present invention thus provides a wearable computer with 

hands-off access to text, images, maps, and other informa- 

This application is a continuation of application Ser. No. tion needed to provide various operations and services. The 

08/399,203 filed on Mar. 6. 1995, now abandoned. 5 ergonomic input device is easy to leam and operates in an 

intuitive manner. The computer system may be used as a 

BACKGROUND OF THE INVENTION maintenance assistant and advisor. The computer system 

c- m f ma y ^ e "Bpten 161116 * 1 using low cost components in a design 

1. Held ot the Invention which minimizes consumption. Those and other 
The present invention relates generally to computers and 10 advantages and benefits of the present invention will become 

input devices, and more specifically to a portable computer apparent from the Description Of A Preferred Embodiment 

system having an ergonomic input device. hereinbelow. 

2. Description of the Invention Background 
The convergence of a variety of technologies is preparing 

the next paradigm shift in information processing for the 15 p or the present invention to be readily understood and 
1990s. Continued advances in semiconductor technology are practiced, preferred embodiments will be described in con- 
producing high performance microprocessors requiring less junction with the following figures wherein: 
power and less space. Decades of research in computer FIG. 1 is a perspective view of a portable computer 
science have provided the technology for hands-off com- system ^ M ergonomic input device constructed accord- 
puling using speech and gesturing for input. Miniature 20 ^ t0 the tcachings of lhe presenl 

heads-up displays weighing less than a few ounces com- ~ . . . , r 

• »• . l * i •„ FIG. 2 is a high level block diagram of the electronics of 

bined with mobile communication technology make it pos- , 6 . . Zjl . 

, c . c L i.- the portable computer system shown in FIG. 1; 

sible for users to access information anywhere. It is even * F 3 * 

possible to sense a user's position such that the information FIG - 3 ^ ^ electrical schematic of the input interface of 

can be superimposed upon the user's workspace. 25 the block diagram of FIG. 2; 

Currently, wearable and other types of portable computers FIG - 4 ^ustrates a sample screen; 

are all hampered by the need for the user to be able to input FIG. 5 is a flow chart illustrating the relationship between 

information or commands in an ergonomic and convenient the operation of the ergonomic input device of the present 

manner. The use of a full size keyboard cancels many of the invention and the position of a hot spot on a display; and 

benefits gained by having a small portable or wearable 30 FIG. 6 illustrates the computer system of the present 

computer. The provision of a keyboard also assumes that the invention in use in a maintenance setting, 
user of the computer, perhaps a maintenance worker, will be 

capable of using the keyboard in an efficient manner. A DESCRIPTION OF A PREFERRED 

mouse input device overcomes the problems associated with EMBODIMENT 

a keyboard, but the use of a mouse becomes impractical in A porta bl e computer system with an ergonomic input 

confined areas where there is no flat surface on which to device constructed according to the teachings of the present 

operate the device. Track balls alleviate that problem, but invention is illustrated in a prospective view in FIG. 1 and 

many people find such devices diOScult to operate. as a 5lock diagram m FIG. 2. The computer system 10 is 

Furthermore, the delicate mechanism of a track ball would comprised of a housing 12 which carries a central processing 

quickly become inoperative in a manufacturing or mainte- unit ( CPU ) 14 and an input i nter f ace 16. The housing 12 also 

nance environment where workers' hands are often heavily has a tQp surface 18 wnich carrics ^ ergonomic input device 

soiled. Voice input is hampered by the diflBculties inherent in 2 0. The ergonomic input device 20 is comprised of a rotary 

enabling computers to understand the spoken word. Thus the switch or dial 22 and on/off switches 24a, 24b, and 24c. The 

need exists for a rugged, ergonomic, inexpensive, input computer system 10 is additionally comprised of a heads-up 

device that can be used with a portable computer system to display 2 e of a known type. The display is under the control 

allow the full benefits of the portable computer system to be of the cpu 14 and may be carried by a Mx or headband 28 

realized. which may be an adjustable type of headband worn by the 



SUMMARY OF THE PRESENT INVENTION 



user so that display 26 may be positioned proximate to the 
50 user's eye. (See FIG. 6) 

The present invention is directed to a portable computer The rotary switch 22 may be a 16 position, binary coded, 

system with an ergonomic input device that is rugged, easy rotary switch, which outputs a four-digit gray code repre- 

to use, and inexpensive. The computer system is comprised senting the switch's position. A gray code is a special binary 

of a housing having a top surface. A central processing unit encoding scheme where adjacent numbers or positions have 

is carried in the housing. A heads-up display is provided for 55 codes that differ in only one bit position. That prevents 

displaying information to a user, with certain of the infor- invalid readings should the position of the rotary switch 22 

matioo being selectable by the user. The display is under the be sampled during a transition. The switches 24a, 246, 24c 

control of the central processing unit. A first rotary switch may be momentary pushbutton switches positioned so as to 

produces a first input signal for identifying the information surround the rotary switch 22. 

to be selected. A second input switch produces a second 60 Turning to FIG. 3, an electrical schematic of the input 

input signal for selecting the identified information. Both the interface 16 is illustrated. The input interface translates the 

first and second input switches are carried on the lop surface movement of the rotary switch 22 and the depressions of the 

of the housing. An input interface receives the first and switches 24a, 24£>, 24c into data in a form that the CPU 14 

second input signals and inputs the information contained in C an accept. In FIG. 3, four conductors 30 carry a first input 

those signals to the central processing unit. 65 signal produced by the rotary switch 22. The first input 

In one embodiment, the housing may be carried in a case signal preferable sequentially identifies the information on 

which is worn by the user while the heads-up display is the screen that is selectable. Conductors 32, 34, and 36 carry 
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signals produced by switches 24a, 24b, and 24c, current position instead of its movement. The mput connec- 
respectively, which signals are used to select an identified tor has provision for eight input lines. That could be used for 
piece of information. A pair of conductors 38 may be one 16-position dial and four button switches, two dials and 
connected to a circuit 80 of known construction which eight button switches, or some combination of dials, buttons, 
indicates battery life. A green LED 82 is lit when battery 5 and other devices, simply by reprogramming the PIC micro- 
voltage is acceptable and a red LED 84 flashes when battery controller. 

voltage is low In FIG. 4, a sample screen is illustrated which may be 

The group of conductors 30, and the individual conduc- vis * le "iff^ K 26 ' *7f a ,.^f tra |£ 8 " m ™ n n d 

i***a ah - *.u u ■ u » An • ♦ window 44 which has options identified as Next Item 50, 

tors 32, 34 and 36 are input through a resistive bank 40 into {{Qm „ and ^ Seclion Menu" 52. The screen also 

input interface 16 The :mput interface 16 may be imple- 10 ^ ^ ^ fc ^ ^ ^ 

mented using a PIC16LC71 microcontroller from Microchip identified as "Status" 56 and "Comments" 55. Two arrows 

Technology, Inc. Such a microcontroller may be pro- are ^ iU ustrated on the screen identified as 53 and 54 to 

grammed to accept the first and second input signals and enaD i e me ^ t0 up or down> respectively. As is 

encode the information contained therein into, for example, known, a particular portion of the screen can be selected to 

an eight bit byte of the type described hereinbelow. The eight " per f orm ^ action. Such zones are recognizable by their 

bit byte contains the user input which is then transmitted to boldness, as shown by the word "Status" 56, or by a blinking 

the CPU 14 through a serial port. cursor. Such zones are referred to as hot spots. The user can 

The PIC microcontroller was chosen for a number of move through the hot spots 50, 51, 52, 53, 54, 55, and 56 by 

reasons. First, one of the important characteristics of the rotating the rotary switch 22 in a clockwise direction, 

computer system 10 is power consumption. The PIC micro- 20 Rotalion of the ratar y swilc h 22 in a counterclockwise 

controller has a sleep mode. That mode halts the oscillator P osition causes the user to move through the hot spots in a 

and puts the microcontroUer in a special low-power mode reverse order When the desired hot spot is ^nUfied as 

which draws less than one micro-amp of current. The m ^ ^ of * e ™"*? t 24a > 24b > *4c may 

.... ..... . _, . ... be depressed to select the identified hot spot. 

built-in watchdog timer can be preprogrammed to wake the • . <• . 

PIC microcontroUer from the sleep mode after a predeter- 25 . A "ock digram ,1 ustratwg the operation of the software 

. . r . „, K t „ . \. , which controls the interaction between the ergonomic input 

mined amount of time lUe PIC microcontroller is the only deyice 2Q and ^ coQtrol Qf ^ ^ oq ^ ^ ^ 

par of the system that is connected to power, because the fe ^strated m F1G 5 In nG 5 a F screen is dr ^ WQ or 

pull-up resistors (not shown) for the rotary switch 22 and redrawQ at step 62 ncm ^ process mntm \ proceeds to 

push-button switches 24a, 246, and 24c are contained within step 64 m which the software awaits mput from the ^ i>e . f 

the PIC microcontroller, and can be turned on and off at will. the eight bit 5yte of iQ f ormation provided to the CPU 14 

Because the PIC microcontroller is programmed to spend from lhe input illt erface 16. When input is received from the 

most of its time sleeping, there is very low power consump- user> step 66 determines if a selection has been made, i.e. 

tl0n - whether one of the switches 24a, 24ft, 24c has been 

Second, the PIC microcontroller contains most of the 35 depressed. If none of the switches has been depressed, then 

necessary circuitry on board. The only electrical compo- the input must be rotation of the rotary switch 22 and process 

nents necessary, aside from the microcontroller, are the control proceeds with step 68. At step 68, a determination is 

rotary switch 22, push-button switches 24a, 24b, 24c, the made if the switch 22 has been rotated clockwise. If so, 

resistor bank 40, a 2.0 MHz crystal 42 and associated process control proceeds with step 72 wherein the next hot 

components needed to form an oscillator 43. As a result, the 4Q spot becomes the active hot spot. If the rotary switch has 

ergonomic input device 20 and input interface 16 is very been rotated counterclockwise, process control proceeds 

small, which is of great importance in the field of portable with step 70 in which the previous hot spot becomes the 

or wearable computers. current hot spot. After either step 70 or 72, process control 

User input may be transmitted to the CPU 14 as one byte returns to step 64 to await additional user input, 

for every switch 24a, 24b, 24c depression or every turn of 45 If at the select step 66 a selection was made, process 

rotary switch 22. The data byte consists of six significant control proceeds with step 74 to determine if a system 

bits. Bits 5 and 6 represent the rotary switch turning clock- command had been invoked. If not, the type of hot spot is 

wise and counterclockwise, respectively. If one of those bits checked at step 76, the relevant code is executed, and the 

is set to one, then the bits 0 through 4 represent the gray code screen is redrawn at step 62. If, on the other hand, a system 

input signal. If both of those bits are set to zero, then bits 0 50 command is invoked at step 74, at step 78 an execution of 

through 4 represent four possible switches (of which only the next screen or previous screen, as appropriate, is per- 

tbree are currently used). If any of bits 0 through 4 is set to formed and the appropriate screen is redrawn at step 62. 

1, then the corresponding switch was just depressed. It is Thereafter, process control returns to step 64 to await 

possible for more than one bit to be set in a data byte, if a additional user input. In that manner, the rotation of the 

user presses two switches at the same time, for example. 55 rotary switch 22 coupled with operation of the push-button 

However, a byte is transmitted only when a switch is switches 24a, 24b, 24c controls the hot spot and ultimately 

depressed or the dial is turned. That allows the software to controls the information displayed on the display 26. Those 

set an interrupt on the serial port to which the PIC micro- of ordinary skill in the art will recognize that the Mow chart 

controller is connected, and use the interrupt handler to illustrated in FIG. 5 can be implemented in software in a 

monitor user input. 60 variety of ways. 

Currently, the PIC microcontroller runs at 2.0 MHz, and We have found that the rotary switch 22 is a very 

transmits data at 9600 baud. All of that is, of course, convenient input device for a range of applications such as 

programmable as are the transmission codes and events where the user is wearing gloves, performing maintenance 

causing a transmission. For example, the interface 16 could or manufacturing in a confined environment, in areas with 

be programmed to transmit keyboard scan codes or ASCII 65 dirt, fuel, corrosive chemicals, etc. 

characters. Codes can be transmitted when switches are Although the input device 20 of the present invention may 

released as well as pressed, or based on the rotary switch's be used to control the hot spot with any type of document 
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displayed on the display 26, use of rotary switch 22 and 
push-button switches 24a, 246, and 24c is particularly 
advantageous for browsing through a hypertext document. 
The hypertext links may be specified by the hypertext 
document author. Whenever the user selects a hypertext link, 
which is represented as a hot spot, the relevant hypertext 
page will be shown on the screen. The computer system 10 
of the present invention can provide an extremely large 
volume of information to the user such that it becomes a tool 
in the user's environment much like pencils or reference 
books. The computer system 10 can provide automatic, 
portable, convenient access to extremely large volumes of 
information. As a result, the following applications are 
envisioned. 

Self-guiding navigation — Through position sensing the 
computer system 10 can help a user maneuver in a 
strange location by superimposing information on a 
see -through display precisely in the direction the user is 
looking at the moment of inquiry. 
See-through reality for manufacturing — Construction 
engineers for such diverse industries as aircraft, 
buildings, chemical plants, and shipbuilding have large, 
oversized blueprints that frequently have to be refer- 
enced during the construction process. The computer 
system 10 would allow this information to be carried by 
the construction worker to the point of application, 
thereby increasing efficiency and decreasing errors. 
Maintenance — As systems become more reliable and 
more complex, maintenance and repair become 
increasingly challenging problems. The computer sys- 
tem 10 superimposes maintenance information upon 
the actual artifact, can use highlighting and animation 
to identify components, and the procedures necessary 
to replace them. 
Medical — Large medical databases are still centrally 
located making access to information time-consuming. 
The computer system 10 would allow a physician to 
call up multi-media information ranging from textual 
diagnosis and graphs of vital signs, to x-rays while 
treating the patient. 
Returning to FIG. 1, the housing 12 may be designed to 
withstand shock, temperature, water, and dirt. A link may be 
provided between the CPU 14 and a main computer (not 
shown) so that results from inspection checklists, manufac- 
turing checklists, etc. can be uploaded for scheduling and 
planning. The CPU 14 may be used in conjunction with 
another board controlling memory cards or other devices 
such as a transmitter/receiver in a modular fashion. By 
providing a carrying case 58 of the type shown in FIG. 6, 
together with a belt 60, the computer system 10 can be 
conveniently used in maintenance, manufacturing, and other 
settings. 

The present invention thus provides a wearable computer 
with hands-off access to text, images, maps, and other 
information needed to provide various operations and ser- 
vices. The ergonomic input device 20 is easy to learn and 
operate in an intuitive manner. As a maintenance assistant 
and advisor, the computer system 10 of the present invention 
can provide: 

help in determining equipment status accurately and rap- 
idly; 

easily accessible and extensive expert information for 

on-the-job support; 
job aid to insure accuracy and diminished need for 

extensive training; and 
status information to a fast automated system for problem 

sorting and generating work orders. 
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Although the present invention has been described in 
conjunction with preferred embodiments thereof, it is 
expected that many modifications and variations will be 
developed. This disclosure and the following claims are 
5 intended to cover all such modifications and variations. 

What is claimed is: 

1. A portable computer system with an ergonomic input 
device, comprising: 

a housing having a surface; 
10 a processing unit carried in said housing; 

a two-dimensional heads-up display for displaying infor- 
mation to a user, certain of the information being 
selectable by the user, said display being under the 
control of said processing unit; 
a first input rotary switch centered in said housing and 
having a single degree of freedom for producing a first 
signal for identifying the information to be selected, in 
a predetermined sequence, without moving all of said 
20 information being selectable by the user; 

a second input switch at a periphery of said first switch for 
producing a second signal for selecting the identified 
information, said first and second input switches car- 
ried on said surface of said housing; and 
25 an input interface for receiving said first and second 
signals and for inputting the information contained in 
said first and second signals to said processing unit, 
said first signal being mapped to a position on said 
display. 

30 2. The computer system of claim 1 wherein said first input 
rotary switch includes a rotary switch for producing a first 
signal that is a gray code signal. 

3. The computer system of claim 2 wherein said second 
input switch includes a plurality of pushbutton switches each 

35 producing a second signal for selecting the identified infor- 
mation. 

4. The computer system of claim 1 wherein said display 
includes a headband carrying said display such that the 
display my be positioned proximate to a user's eye. 

40 5. The computer system of claim 4 additionally compris- 
ing a case for carrying said housing and a belt connected to 
said case so that the housing may be worn by the user. 

6. The computer system of claim 1 wherein said interface 
includes a microcontroller for receiving said input signals 

45 and for producing an eight bit byte having the information 
from said input signals coded therein. 

7. A portable computer system having an ergonomic input 
device, comprising: 

a housing having a surface; 
a central processing unit carried in said housing; 
a two dimensional heads-up display for displaying infor- 
mation to a user, certain of the information being 
selectable by the user, said display being under the 
control of said central processing unit; 
a first input rotary switch centered in said housing and 
having a single degree of freedom for producing a first 
signal; 

a second input switch at a periphery of said first switch for 
go producing a second signal, said first and second input 
switches being carried on said surface of said housing; 
and 

a software routine running on said central processing unit, 
said routine for receiving said first and second signals 
65 and for mapping said first signal to one of a number of 
positions on said display, in a predetermined sequence, 
without moving all of said information being selectable 
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by the user, and for selecting certain information in 
response to said second signal. 

8. The computer system of claim 7 wherein said rotary 
switch is sized to be easily rotated. 

9. The computer system of claim 8 wherein said rotary 
switch is triangularly shaped and has an indentation in one 
point of the triangle. 

10. The computer system of claim 8 wherein said rotary 
switch has a plurality of discrete positions. 

11. The computer system of claim 7 wherein said second 
signal causes said central processing unit to perform a 
function that is related to the displayed information. 

12. A computer system, comprising: 
a housing having a surface; 

a central processing unit carried in said housing; 

a two-dimensional heads-up display under the control of 
said central processing unit, said display for displaying 
a plurality of information items in a predetermined 
order; 

a first input rotary switch centered in said housing and 
having a single degree of freedom for producing a first 
signal; 

a second input switch at a periphery of said first switch for 
producing a second signal, said first and second 
switches being carried on said surface of said housing; 
and 

means executed on said central processing unit for cycling 
through said predetermined order of information items 
in a first direction, without moving all of said infor- 
mation items, in response to rotation of said rotary 
switch in a first direction and for cycling through said 
predetermined order of information items in an oppo- 
site direction, without moving all of said information 
items, in response to rotation of said rotary switch in a 
direction opposite to said first direction, and for select- 
ing an information item in response to said second 
signal. 

13. The computer system of claim 12 wherein said rotary 
switch is sized to be easily rotated. 

14. The computer system of claim 13 wherein said rotary 
switch is triangularly shaped and has an indentation in one 
point of the triangle. 

15. The computer system of claim 13 wherein said rotary 
switch has a plurality of discrete positions. 

16. The computer system of claim 12 wherein said second 
signal causes said central processing unit to perform a 
function that is related to the displayed information. 
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17. A combination, comprising: 

a heads-up display having at least two dimensions; 

a rotary input device centered in said housing and having 
5 a single degree of freedom; 

a second input at a periphery of said first input; 

a processor, connected to said display and said first and 
second input devices, for selecting, in a predetermined 
io sequence, among a plurality of predetermined regions 
of said display, without moving all of said predeter- 
mined regions of said display, and in response to said 
rotary input device. 

18. The combination of claim 17 wherein said rotary input 
15 device has a plurality of discrete positions. 

19. The combination of claim 18 wherein said processor 
selects among said plurality of predetermined regions in a 
predetermined sequence responsive to rotation of said rota- 
tional input device. 

20 20. The combination of claim 19 wherein said processor 
selects the next sequential said predetermined region in 
response to movement of said rotational input device 
between said adjacent discrete positions. 

25 21. The combination of claim 17 wherein said rotational 
input device is triangular in shape. 

22. The computer of claim 21 wherein said triangular 
input device has an indentation on its top surface. 

23. A method of mapping a one dimensional signal to a 
30 two dimensional heads-up display, comprising the steps of: 

establishing a sequence of hot spots on the heads-up 
display; 

moving, in a predetermined order, through said sequence 
of hot spots in one of first and second directions, 
without moving all of said hot spots, in response to first 
input signal, the amount of movement being propor- 
tional to the displacement of a rotary switch; and 

selecting a hot spot in response to a second input signal 
40 from a switch at a periphery of the rotary switch. 

24. The method of claim 23, wherein rotation of said 
rotary switch in a clockwise direction causes activation of 
said hot spots in the first direction and wherein rotation of 
said rotary switch in a counter clockwise direction causes 

45 activation of said hot spots in a second direction opposite to 
said first direction. 

***** 
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